PATTERN RECOGNITION IN CLASS IMBALANCED DATASETS

Class imbalanced datasets constitute a significant portion of the machine learning problems of interest, where recog­nizing the ‘rare class’ is the primary objective for most applications. Traditional linear machine learning algorithms are often not effective in recognizing the rare class. In this research work, a specifically optimized feed-forward artificial neural network (ANN) is proposed and developed to train from moderate to highly imbalanced datasets. The proposed methodology deals with the difficulty in classification task in multiple stages—by optimizing the training dataset, modifying kernel function to generate the gram matrix and optimizing the NN structure. First, the training dataset is extracted from the available sample set through an iterative process of selective under-sampling. Then, the proposed artificial NN comprises of a kernel function optimizer to specifically enhance class boundaries for imbalanced datasets by conformally transforming the kernel functions. Finally, a single hidden layer weighted neural network structure is proposed to train models from the imbalanced dataset. The proposed NN architecture is derived to effectively classify any binary dataset with even very high imbalance ratio with appropriate parameter tuning and sufficient number of processing elements. Effectiveness of the proposed method is tested on accuracy based performance metrics, achieving close to and above 90%, with several imbalanced datasets of generic nature and compared with state of the art methods. The proposed model is also used for classification of a 25GB computed tomographic colonography database to test its applicability for big data. Also the effectiveness of under-sampling, kernel optimization for training of the NN model from the modified kernel gram matrix representing the imbalanced data distribution is analyzed experimentally. Computation time analysis shows the feasibility of the system for practical purposes. This report is concluded with discussion of prospect of the developed model and suggestion for further development works in this direction

U-Net and its variants for medical image segmentation: theory and applications

U-net is an image segmentation technique developed primarily for medical image analysis that can precisely segment images using a scarce amount of training data. These traits provide U-net with a very high utility within the medical imaging community and have resulted in extensive adoption of U-net as the primary tool for segmentation tasks in medical imaging. The success of U-net is evident in its widespread use in all major image modalities from CT scans and MRI to X-rays and microscopy. Furthermore, while U-net is largely a segmentation tool, there have been instances of the use of U-net in other applications. As the potential of U-net is still increasing, in this review we look at the various developments that have been made in the U-net architecture and provide observations on recent trends. We examine the various innovations that have been made in deep learning and discuss how these tools facilitate U-net. Furthermore, we look at image modalities and application areas where U-net has been applied.Comment: 42 pages, in IEEE Acces

U-net and its variants for medical image segmentation: A review of theory and applications

U-net is an image segmentation technique developed primarily for image segmentation tasks. These traits provide U-net with a high utility within the medical imaging community and have resulted in extensive adoption of U-net as the primary tool for segmentation tasks in medical imaging. The success of U-net is evident in its widespread use in nearly all major image modalities, from CT scans and MRI to Xrays and microscopy. Furthermore, while U-net is largely a segmentation tool, there have been instances of the use of U-net in other applications. Given that U-net’s potential is still increasing, this narrative literature review examines the numerous developments and breakthroughs in the U-net architecture and provides observations on recent trends. We also discuss the many innovations that have advanced in deep learning and discuss how these tools facilitate U-net. In addition, we review the different image modalities and application areas that have been enhanced by U-net

U-net Based Deep Learning Architectures for Object Segmentation in Biomedical Images

U-net is an image segmentation technique developed primarily for medical image analysis that can precisely segment images using a scarce amount of training data. These traits provide Unet with a high utility within the medical imaging community and have resulted in extensive adoption of U-net as the primary tool for segmentation tasks in medical imaging. The success of U-net is evident in its widespread use in nearly all major image modalities from CT scans and MRI to X-rays and microscopy. Furthermore, while U-net is largely a segmentation tool, there have been instances of the use of U-net in other applications. Given that U-net\u27s potential is still increasing, this review examines the numerous developments and breakthroughs in the U-net architecture and provides observations on recent trends. We also discuss the many innovations that have advanced in deep learning and discuss how these tools facilitate U-net. In addition, we review the different image modalities and application areas that have been enhanced by U-net. In recent years, deep learning for health care is rapidly infiltrating and transforming medical fields thanks to the advances in computing power, data availability, and algorithm development. In particular, U-Net, a deep learning technique, has achieved remarkable success in medical image segmentation and has become one of the premier tools in this area. While the accomplishments of U-Net and other deep learning algorithms are evident, there still exist many challenges in medical image processing to achieve human-like performance. In this thesis, we propose a U-net architecture that integrates a residual skip connections and recurrent feedback with EfficientNet as a pretrained encoder. Residual connections help feature propagation in deep neural networks and significantly improve performance against networks with a similar number of parameters while recurrent connections ameliorate gradient learning. We also propose a second model that utilizes densely connected layers aiding deeper neural networks. And the proposed third model that incorporates fractal expansions to bypass diminishing gradients. EfficientNet is a family of powerful pretrained encoders that streamline neural network design. The use of EfficientNet as an encoder provides the network with robust feature extraction that can be used by the U-Net decoder to create highly accurate segmentation maps. The proposed networks are evaluated against stateof-the-art deep learning based segmentation techniques to demonstrate their superior performance

Recurrent residual U-net with efficientnet encoder for medical image segmentation

In recent years, deep learning for health care is rapidly infiltrating and transforming medical fields thanks to the advances in computing power, data availability, and algorithm development. In particular, U-Net, a deep learning technique, has achieved remarkable success in medical image segmentation and has become one of the premier tools in this area. While the accomplishments of U-Net and other deep learning algorithms are evident, there still exist many challenges in medical image processing to achieve human-like performance. In this paper, we propose a U-net architecture that integrates a residual skip connections and recurrent feedback with EfficientNet as a pretrained encoder. Residual connections help feature propagation in deep neural networks and significantly improve performance against networks with a similar number of parameters while recurrent connections ameliorate gradient learning. We also propose a second model that utilizes densely connected layers aiding deeper neural networks. EfficientNet is a family of powerful pretrained encoders that streamline neural network design. The use of EfficientNet as an encoder provides the network with robust feature extraction that can be used by the U-Net decoder to create highly accurate segmentation maps. The proposed networks are evaluated against state-of-the-art deep learning based segmentation techniques to demonstrate their superior performance

Short- and mid-term forecasts of actual evapotranspiration with deep learning

Evapotranspiration is a key component of the hydrologic cycle. Accurate short-, medium-, and long-term forecasts of actual evapotranspiration (ETa) are crucial not only for quantifying the impacts of climate change on the water and energy balance, but also for real-time estimation of crop water demand and irrigation water allocation in agriculture. Despite considerable advances in satellite remote sensing technology and the availability of long ground-measured and remotely sensed ETa timeseries, real-time ETa forecasts are deficient. Applying a state-of-the-art deep learning (DL) approach, Long Short-Term Memory (LSTM) models were employed to nowcast (real-time) and forecast (ahead of time) ETa based on (1) major meteorological and ground-measured (i.e., soil moisture) input variables and (2) long ETa timeseries from the Moderate Resolution Imaging Spectroradiometer (MODIS) onboard of the NASA Aqua satellite. The conventional LSTM and convolutional LSTM (ConvLSTM) DL models were evaluated for seven distinct climatic zones across the contiguous United States. The employed LSTM and ConvLSTM models were trained and evaluated with data from the National Climate Assessment-Land Data Assimilation System (NCA-LDAS) and with MODIS/Aqua Net Evapotranspiration MYD16A2 product data. The obtained results indicate that when major atmospheric and soil moisture input variables are used for the conventional LSTM models, they yield accurate daily ETa forecasts for short (1, 3, and 7 days) and medium (30 days) time scales, with normalized root mean squared errors (NRMSE) and Nash-Sutcliffe efficiencies (NSE) of less than 10% and greater than 0.77, respectively. At the watershed scale, the univariate ConvLSTM models yielded accurate weekly spatiotemporal ETa forecasts (mean NRMSE less than 6.4% and NSE greater than 0.66) with higher computational efficiency for various climatic conditions. The employed models enable precise forecasts of both the current and future states of ETa, which is crucial for understanding the impact of climate change on rapidly depleting water resources

Estimation of root zone soil moisture from ground and remotely sensed soil information with multisensor data fusion and automated machine learning

Root zone soil moisture (RZSM) estimation and monitoring based on high spatial resolution remote sensing information such as obtained with an Unmanned Aerial System (UAS) is of significant interest for field-scale precision irrigation management, particularly in water-limited regions of the world. To date, there is no accurate and widely accepted model that relies on UAS optical surface reflectance observations for RZSM estimation at high spatial resolution. This study is aimed at the development of a new approach for RZSM estimation based on the fusion of high spatial resolution optical reflectance UAS observations with physical and hydraulic soil information integrated into Automated Machine Learning (AutoML). The H2O AutoML platform includes a number of advanced machine learning algorithms that efficiently perform feature selection and automatically identify complex relationships between inputs and outputs. Twelve models combining UAS optical observations with various soil properties were developed in a hierarchical manner and fed into AutoML to estimate surface, near-surface, and root zone soil moisture. The addition of independently measured surface and near-surface soil moisture information to the hierarchical models to improve RZSM estimation was investigated. The accuracy of soil moisture estimates was evaluated based on a comparison with Time Domain Reflectometry (TDR) sensors that were deployed to monitor surface, near-surface and root zone soil moisture dynamics. The obtained results indicate that the consideration of physical and hydraulic soil properties together with UAS optical observations improves soil moisture estimation, especially for the root zone with a RMSE of about 0.04 cm cm . Accurate RZSM estimates were obtained when measured surface and near-surface soil moisture data was added to the hierarchical models, yielding RMSE values below 0.02 cm cm and R and NSE values above 0.90. The generated high spatial resolution RZSM maps clearly capture the spatial variability of soil moisture at the field scale. The presented framework can aid farm scale precision irrigation management via improving the crop water use efficiency and reducing the risk of groundwater contamination

Fractal, recurrent, and dense U-Net architectures with EfficientNet encoder for medical image segmentation

PURPOSE: U-Net is a deep learning technique that has made significant contributions to medical image segmentation. Although the accomplishments of deep learning algorithms in terms of image processing are evident, many challenges still need to be overcome to achieve human-like performance. One of the main challenges in building deeper U-Nets is black-box problems, such as vanishing gradients. Overcoming this problem allows us to develop neural networks with advanced network designs. APPROACH: We propose three U-Net variants, namely efficient R2U-Net, efficient dense U-Net, and efficient fractal U-Net, that can create highly accurate segmentation maps. The first part of our contribution makes use of EfficientNet to distribute resources in the network efficiently. The second part of our work applies the following layer connections to design the U-Net decoders: residual connections, dense connections, and fractal expansion. We apply EfficientNet as the encoder to our three decoders to design three conceivable models. RESULTS: The aforementioned three proposed deep learning models were tested on four benchmark datasets, including the CHASE DB1 and digital retinal images for vessel extraction (DRIVE) retinal image databases and the ISIC 2018 and HAM10000 dermoscopy image databases. We obtained the highest Dice coefficient of 0.8013, 0.8808, 0.8019, and 0.9295 for CHASE DB1, ISIC 2018, DRIVE, and HAM10000, respectively, and a Jaccard (JAC) score of 0.6686, 0.7870, 0.6694, and 0.8683 for CHASE DB1, ISIC 2018, DRIVE, and HAM10000, respectively. Statistical analysis revealed that the proposed deep learning models achieved better segmentation results compared with the state-of-the-art models. CONCLUSIONS: U-Net is quite an adaptable deep learning framework and can be integrated with other deep learning techniques. The use of recurrent feedback connections, dense convolution, residual skip connections, and fractal convolutional expansions allow for the design of improved deeper U-Net models. With the addition of EfficientNet, we can now leverage the performance of an optimally scaled classifier for U-Net encoders

Molecular Detection and Multidrug Resistance of Shigella spp. Isolated from Wild Waterfowl and Migratory Birds in Bangladesh

Birds, especially wild waterfowl and migratory birds have the potential to carry antibiotic-resistant bacteria, but their role in the dissemination of these resistant pathogens is still neglected in Bangladesh. To the best of our knowledge, this study was carried out for the first time in Bangladesh to isolate and determine the occurrence of multidrug-resistant (MDR) Shigella spp. from fecal materials of wild waterfowl and migratory birds. A total of 80 fecal materials from wild waterfowl (n = 50) and migratory birds (n = 30) were screened to detect MDR Shigella isolates. Shigella spp. were isolated and identified by culturing, staining, and biochemical tests followed by polymerase chain reaction (PCR). A disk diffusion assay was employed to investigate antibiotic phenotypes, while the resistance genes were detected by PCR. Among the 80 samples, 15 (18.75%) were found positive for Shigella spp. by PCR, among which the occurrence rate of Shigella spp. was higher in migratory birds (20%, 6/30) than in wild waterfowl (18%, 9/50). By the disk diffusion test, 86.67% (13/15) of Shigella spp. isolates were found to be MDR in nature, including 93.33% of isolates resistant to imipenem. Moreover, frequent and moderate resistance was also observed against tetracycline (86.67%), azithromycin (80%), ampicillin (66.67%), ciprofloxacin and cotrimoxazole (40%), meropenem (26.67%), and streptomycin (13.33%). The bivariate analysis revealed a positive correlation between the resistance profiles of ciprofloxacin and cotrimoxazole, imipenem and tetracycline, tetracycline and ampicillin, and imipenem and azithromycin. Furthermore, the isolates had a multiple antibiotic resistance index of up to 0.47. Antibiotic resistance genes tetA and SHV were found in 69.23% and 50% of relevant antibiotic-resistant Shigella spp. isolates, respectively. The present study suggests that wild waterfowl and migratory birds are reservoirs of MDR Shigella spp., which may have detrimental impacts on One Health components. We suggest keeping these birds under an AMR monitoring program to avoid the possibility of AMR contamination of the environment and its consequences in all health settings